We manually curated 500\(+\) multiple modality PPMI MRI subjects. 5 messages from this effort.
failure rates humans vs processed
we provide scientists handles on this so that can be “strict” or “loose” in data selection
we document these parameters
for algorithm developers
for scientists
Enables investigation of the “meaning” of M3RI at the individual level
Empowers investigation of the “meaning” of M3RI at the population level
Reviewing multiple modality data quality for current phase of collection
we collaborated on cohort definition
first phase - select subjects based on sampling from sites
second phase - select subjects based on population characteristics (MJFF/PPMI)
show table of summary cohort
| p | ||||||
|---|---|---|---|---|---|---|
| (N=47) | (N=1) | (N=4) | (N=230) | (N=217) | ||
| age | 63.5 ± 12.5 | 71.9 ± NA | 59.3 ± 7.1 | 67.7 ± 5.7 | 64.5 ± 9.4 | < 0.001 |
we manually QC’d each modality for each of 500 baseline subjects
Summarize QC results for each modality
Summarize results for “joint” quality - how many subjects are high quality across all modalities at once?
| p | ||
|---|---|---|
| (N=549) | ||
| qcfail_orientation | ||
| p | ||
|---|---|---|
| (N=523) | ||
| qcfail_background_noise | ||
| p | ||
|---|---|---|
| (N=502) | ||
| NM_QC_Ratings_Z | < 0.001 | |
| p | |||
|---|---|---|---|
| (N=1204) | (N=1340) | ||
| qcfail_orientation | |||
| p | ||||
|---|---|---|---|---|
| (N=2969) | (N=187) | (N=854) | ||
| qcfail_orientation | ||||
| modality | Total | Successes | Failures | Percent_Success | Percent_Failure | failcat |
|---|---|---|---|---|---|---|
| T1w | 523 | 513 | 10 | 98.08795 | 1.9120459 | qchuman_T1w |
| T1w | 523 | 521 | 2 | 99.61759 | 0.3824092 | qcfail_background_noise |
| T1w | 523 | 519 | 4 | 99.23518 | 0.7648184 | qcfail_motion |
| T1w | 523 | 519 | 4 | 99.23518 | 0.7648184 | qcfail_other |
| modality | Total | Successes | Failures | Percent_Success | Percent_Failure | failcat |
|---|---|---|---|---|---|---|
| T2Flair | 549 | 524 | 25 | 95.44627 | 4.5537341 | qchuman_FLAIR |
| T2Flair | 549 | 548 | 1 | 99.81785 | 0.1821494 | qcfail_orientation |
| T2Flair | 549 | 545 | 4 | 99.27140 | 0.7285974 | qcfail_intensity_saturation |
| T2Flair | 549 | 543 | 6 | 98.90710 | 1.0928962 | qcfail_background_noise |
| T2Flair | 549 | 539 | 10 | 98.17851 | 1.8214936 | qcfail_motion |
| T2Flair | 549 | 547 | 2 | 99.63570 | 0.3642987 | qcfail_other |
| modality | Total | Successes | Failures | Percent_Success | Percent_Failure | failcat |
|---|---|---|---|---|---|---|
| DTIb0 | 1204 | 1110 | 94 | 92.19269 | 7.8073090 | qchuman_DTI |
| DTIdwi | 1340 | 1224 | 116 | 91.34328 | 8.6567164 | qchuman_DTI |
| DTIb0 | 1204 | 1188 | 16 | 98.67110 | 1.3289037 | qcfail_orientation |
| DTIdwi | 1340 | 1324 | 16 | 98.80597 | 1.1940299 | qcfail_orientation |
| DTIb0 | 1204 | 1198 | 6 | 99.50166 | 0.4983389 | qcfail_phantom |
| DTIdwi | 1340 | 1334 | 6 | 99.55224 | 0.4477612 | qcfail_phantom |
| DTIb0 | 1204 | 1204 | 0 | 100.00000 | 0.0000000 | qcfail_intensity_saturation |
| DTIdwi | 1340 | 1336 | 4 | 99.70149 | 0.2985075 | qcfail_intensity_saturation |
| DTIb0 | 1204 | 1154 | 50 | 95.84718 | 4.1528239 | qcfail_background_noise |
| DTIdwi | 1340 | 1286 | 54 | 95.97015 | 4.0298507 | qcfail_background_noise |
| DTIb0 | 1204 | 1150 | 54 | 95.51495 | 4.4850498 | qcfail_motion |
| DTIdwi | 1340 | 1270 | 70 | 94.77612 | 5.2238806 | qcfail_motion |
| DTIb0 | 1204 | 1190 | 14 | 98.83721 | 1.1627907 | qcfail_signal_dropout |
| DTIdwi | 1340 | 1318 | 22 | 98.35821 | 1.6417910 | qcfail_signal_dropout |
| DTIb0 | 1204 | 1188 | 16 | 98.67110 | 1.3289037 | qcfail_other |
| DTIdwi | 1340 | 1324 | 16 | 98.80597 | 1.1940299 | qcfail_other |
| modality | Total | Successes | Failures | Percent_Success | Percent_Failure | failcat |
|---|---|---|---|---|---|---|
| rsfMRI | 2969 | 2512 | 457 | 84.60761 | 15.3923880 | qchuman_rsfMRI |
| rsfMRI_LR | 187 | 168 | 19 | 89.83957 | 10.1604278 | qchuman_rsfMRI |
| rsfMRI_RL | 854 | 758 | 96 | 88.75878 | 11.2412178 | qchuman_rsfMRI |
| rsfMRI | 2969 | 2960 | 9 | 99.69687 | 0.3031324 | qcfail_orientation |
| rsfMRI_LR | 187 | 186 | 1 | 99.46524 | 0.5347594 | qcfail_orientation |
| rsfMRI_RL | 854 | 838 | 16 | 98.12646 | 1.8735363 | qcfail_orientation |
| rsfMRI | 2969 | 2955 | 14 | 99.52846 | 0.4715392 | qcfail_phantom |
| rsfMRI_LR | 187 | 187 | 0 | 100.00000 | 0.0000000 | qcfail_phantom |
| rsfMRI_RL | 854 | 854 | 0 | 100.00000 | 0.0000000 | qcfail_phantom |
| rsfMRI | 2969 | 2955 | 14 | 99.52846 | 0.4715392 | qcfail_spacing |
| rsfMRI_LR | 187 | 187 | 0 | 100.00000 | 0.0000000 | qcfail_spacing |
| rsfMRI_RL | 854 | 854 | 0 | 100.00000 | 0.0000000 | qcfail_spacing |
| rsfMRI | 2969 | 2949 | 20 | 99.32637 | 0.6736275 | qcfail_intensity_saturation |
| rsfMRI_LR | 187 | 177 | 10 | 94.65241 | 5.3475936 | qcfail_intensity_saturation |
| rsfMRI_RL | 854 | 822 | 32 | 96.25293 | 3.7470726 | qcfail_intensity_saturation |
| rsfMRI | 2969 | 2388 | 581 | 80.43112 | 19.5688784 | qcfail_motion |
| rsfMRI_LR | 187 | 187 | 0 | 100.00000 | 0.0000000 | qcfail_motion |
| rsfMRI_RL | 854 | 854 | 0 | 100.00000 | 0.0000000 | qcfail_motion |
| rsfMRI | 2969 | 2804 | 165 | 94.44257 | 5.5574267 | qcfail_signal_dropout |
| rsfMRI_LR | 187 | 172 | 15 | 91.97861 | 8.0213904 | qcfail_signal_dropout |
| rsfMRI_RL | 854 | 806 | 48 | 94.37939 | 5.6206089 | qcfail_signal_dropout |
| rsfMRI | 2969 | 2968 | 1 | 99.96632 | 0.0336814 | qcfail_temporal_noise |
| rsfMRI_LR | 187 | 186 | 1 | 99.46524 | 0.5347594 | qcfail_temporal_noise |
| rsfMRI_RL | 854 | 846 | 8 | 99.06323 | 0.9367681 | qcfail_temporal_noise |
| rsfMRI | 2969 | 2957 | 12 | 99.59582 | 0.4041765 | qcfail_insufficient_volumes |
| rsfMRI_LR | 187 | 187 | 0 | 100.00000 | 0.0000000 | qcfail_insufficient_volumes |
| rsfMRI_RL | 854 | 854 | 0 | 100.00000 | 0.0000000 | qcfail_insufficient_volumes |
| rsfMRI | 2969 | 2968 | 1 | 99.96632 | 0.0336814 | qcfail_FOV |
| rsfMRI_LR | 187 | 187 | 0 | 100.00000 | 0.0000000 | qcfail_FOV |
| rsfMRI_RL | 854 | 854 | 0 | 100.00000 | 0.0000000 | qcfail_FOV |
| NM.QC.cat | Total | Successes | Failures | Percent_Success | Percent_Failure | failcat |
|---|---|---|---|---|---|---|
| overall | 478 | 386 | 92 | 80.75314 | 19.246862 | NM_QC_Ratings_Failures |
| z.coord | 478 | 391 | 87 | 81.79916 | 18.200837 | NM_QC_Ratings_Z |
| sn.vol | 478 | 471 | 7 | 98.53556 | 1.464435 | NM_QC_Ratings_SNVol |
| avg.int | 478 | 473 | 5 | 98.95397 | 1.046025 | NM_QC_Ratings_AvgIntensity |
| sd.int | 478 | 473 | 5 | 98.95397 | 1.046025 | NM_QC_Ratings_SDIntensity |
| max.int | 478 | 473 | 5 | 98.95397 | 1.046025 | NM_QC_Ratings_MaxIntensity |
## Warning in merge.data.frame(temp, temp2, by = "dtid2", all.x = TRUE): column
## names 'qchuman_DTI.x', 'qchuman_DTI.y' are duplicated in the result
## Warning in merge.data.frame(temp, temp2, by = "rsfid1", all.x = TRUE): column
## names 'qchuman_DTI.x', 'qchuman_DTI.y' are duplicated in the result
## Warning in merge.data.frame(temp, temp2, by = "rsfid2", all.x = TRUE): column
## names 'qchuman_DTI.x', 'qchuman_DTI.y', 'qchuman_rsfMRI.x', 'qchuman_rsfMRI.y'
## are duplicated in the result
for each, summarize how processing improves the data
rsfMRI is “easy” to see - throw away motion corrupted data
developed methodology specific for PPMI that was informed by this process
automated QC for these modalities for future work